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Abstract 

The goal of this study was to build the capacity of early childhood teachers to implement 
evidence-based strategies. We investigated the efficacy of professional development with bug-in- 
ear peer coaching in improving teachers’ use of communication strategies, the teachers’ 
maintenance of strategies post intervention, and the social validity of the intervention. Four early 
childhood co-teacher dyads participated in the single-case design study. Data were analyzed 
through visual analysis and masked visual analysis. Results indicate that three of the four teacher 
dyads increased the frequency with which they used the strategies, with one dyad sustaining their 
use targeted strategies post intervention. All teachers perceived that the intervention had positive 
effects on their children and indicated that bug-in-ear peer coaching was an acceptable form of 
professional development. Nonetheless, implications for research and practice are discussed to 
ensure that perfonnance-based feedback is as meaningful as possible. 

Keywords: professional development, bug-in-ear, peer coaching, communication 


strategies, early childhood education 
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Impact of Bug-In-Ear Professional Development on Early Childhood Co-Teachers’ Use of 

Communication Strategies 

Delays in young children’s communication have been associated with enduring academic 
and social challenges (Kaiser & Roberts, 2011). Specifically, children identified with 
communication delays are at risk for manifesting behavioral challenges as well as delays in 
school readiness and literacy development (Homer, Carr, Strain, Todd, & Reed, 2002; Lonigan 
& Shanahan, 2009; Rayner, Foorman, Perfetti, Pesetsky, & Seidenberg, 2001). Early intervention 
has been identified as a technique to change the developmental trajectory of young children 
experiencing delays and disabilities (Dunlap et ah, 2006; Peters-Scheffer, Didden, Korzilius, & 
Matson, 2012; Talay-Ongan, 2001), and therefore, it is critical to consider and utilize 
interventions associated with positive communicative outcomes for children. 

One way to enhance the communication skills of young children is utilizing the child’s 
natural environment to embed intervention (Stanton-Chapman, Kaiser, Vijay, & Chapman, 2008; 
Hancock & Kaiser, 2002). One evidence-based practice that takes advantage of the natural 
environment is naturalistic intervention, which utilizes typically occurring routines to embed 
learning opportunities throughout the day (DiCarlo, & Vagianos, 2009; Wolery & Hemmeter, 
2011). Naturalistic intervention has been identified as an effective strategy for children at risk for 
and identified with disabilities and is recommended for enhancing skills such as communication 
(Rule, Losardo, Dinnebeil, Kaiser, & Rowland, 1998; Stanton-Chapman et ah, 2008). 

Although evidence-based practices, such as naturalistic intervention, have been identified 
as effective in enhancing children’s development, there is a recognized research-to-practice gap 
during implementation under typical classroom conditions (Odom, 2008). Namely, teachers do 
not always utilize naturalistic intervention to embed communication strategies into typically 
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occurring routines (Ottley & Hanline, 2014; Schwartz, Carta, & Grant, 1996). Several strategies 
have been researched as potential solutions to this problem, such as trainings that include 
interactive activities and teacher reflections paired with coaching (Brown & Woods, 2012; 
Charteris, & Smardon, 2013; Dunst & Trivette, 2009; Raver et ah, 2014). Coaching techniques 
with demonstrated effectiveness include providing performance-based feedback that is specific, 
immediate, positive, and corrective (Scheeler, Ruhl, & McAfee, 2004). When these techniques 
have been utilized, coaching has enhanced teacher outcomes, such as increasing teachers’ use of 
positive behavior interventions and support, instructional strategies, and interactions with 
children (e.g., Kretlow et ah, 2012; Reinke, Stonnont, Herman, & Newcomer, 2014; Zan & 
Ritter, 2013). Coaching has been adopted by several states to support teachers’ implementation 
of evidence-based practices and ameliorate the research-to-practice gap (Woulfin, 2014). 

One specific type of coaching with great potential to reduce the research-to-practice gap 
is peer coaching, which is defined as teachers observing one another and providing reciprocal 
feedback with the goal of enhancing instruction (Scheeler, Congdon, & Stansbery, 2010). Peer 
coaching has benefits over other types of coaching, such as assisting teachers in overcoming 
barriers associated with assignments in their respective professional roles, being contextually 
relevant, and receiving feedback from someone with whom teachers have rapport and a positive 
relationship (Fry & Hin, 2006; Scheeler et al., 2010). Importantly, peer coaching has positively 
impacted teachers’ content knowledge, problem solving skills, teaching techniques, and self- 
efficacy (e.g., Jang, 2010; Lantz, Neumeister, Adams, & Pierce, 2009; Slater & Simmons, 2001). 

Another specific type of coaching is bug-in-ear (BIE) coaching. This form of coaching 
emphasizes the immediacy of coaching feedback by using technology to deliver feedback in real 
time while teachers interact with children in their classrooms. Most notably, in early childhood 
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(EC) environments, BIE coaching has enhanced the communication strategies used by EC 
general and special education teachers during coaching sessions when delivered by researchers 
(Coogle, Ottley, Rahn, & Storie, 2016; Coogle, Rahn, Ottley, & Storie, in press; Ottley & 
Hanline, 2014). However, when coaching was removed in these studies, teachers’ use of the 
strategies was variable. 

A few researchers have combined BIE coaching with peer coaching to enhance teachers’ 
instructional practices. For example, Scheeler et al. (2010) utilized BIE peer coaching with three 
general- and special-education teacher dyads in second-, third-, and seventh-grade classrooms. 
Results suggested BIE peer coaching increased teachers’ acquisition and maintenance of 
complete learning units. Additionally, Fry and Hin (2006) utilized peer coaching over four 
weekly lessons to enhance communication across pre-service teacher dyads. Dyads provided 
feedback to one another during physical education lessons with results suggesting that the 
teachers received regular reinforcement on their teaching practices and were satisfied with the 
responsibilities of their collaborative roles. 

Because there is a research-to-practice gap specific to utilizing communication strategies, 
and previous research suggesting positive outcomes associated with peer- and BIE-coaching on 
teachers’ communication strategy use, we sought to further examine the efficacy of BIE peer 
coaching as a component of a PD package. More specifically, the purpose of this study was to 
detennine the efficacy of PD that included BIE peer coaching on EC teachers’ (i.e., co-teacher 
dyads) use of evidence-based strategies. The first aim of this study was to detennine the extent to 
which PD (i.e., training, BIE peer coaching, weekly reflections) improved the frequency with 
which EC teachers used evidence-based communication strategies within typical classroom 
routines. Because differences between conditions were large in other studies with EC teachers 
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(e.g., Coogle et al., 2016), we hypothesized that the frequency of usage would at least triple 
during intervention compared with baseline. The second aim was to determine the extent to 
which EC teachers sustained their use of strategies post intervention. Given the variability of 
sustained outcomes from previous studies (e.g., Ottley & Hanline, 2014), we hypothesized that 
the frequency of strategy use would decline, but would remain at least double that of baseline. 
The third aim was to identify the extent to which EC teachers perceived BIE peer coaching to be 
a socially valid form of PD. Based on our previous results (Ottley, Coogle, & Rahn, 2015), we 
hypothesized that teachers would perceive BIE peer coaching to be an appropriate fonn of PD. 

Methods 

Participants 

Four EC teacher dyads (i.e., (1) Desi and Alante; (2) Deanna and Bess; (3) Elise and 
Francesca; (4) Zaire and Iza; pseudonyms; see Table 1) participated in this research. Seven 
teachers completed all phases of the research; one teacher (Alante) completed the first two 
phases. All teachers taught children between 6 weeks to 3 years of age in a university- affiliated 
EC center in a large city in the Midwest. Each teacher provided their informed consent to 
participate in the research prior to starting the project. Teachers’ ages ranged from 24 to 35 years 
and they had between 1 and 12 years of experience working with children birth through three 
years. Four teachers were Caucasian, two were African American, one was Asian Indian, and 
one was of more than one race. Teachers’ highest level of education was an Associate’s (n = 1), 
Bachelor’s (n = 4), or Master’s (n = 3) degree. Four teachers were master teachers, two were lead 
teachers, and two were assistant teachers. Master and lead teachers developed the curriculum and 
were responsible for monitoring children’s learning progress. Master teachers were also 
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responsible for managing the teaching team, supervising the other teachers, and providing them 
with feedback. All teachers provided instruction to the children. 

Single-Case Research Design 

We used a multiple-baseline single-case research design to detennine the effects of the 
PD on teachers’ use of communication strategies. The study’s design met What Works 
Clearinghouse standards (v. 3) for single-case research without reservations (Kratochwill et ah, 
2013). Additionally, we randomized the order in which the four dyads received intervention as 
well as the start-point for intervention and maintenance phases (Kratochwill & Levin, 2010). 
Measures 

Communication strategies. The primary outcome of interest was the frequency with 
which the EC teachers used targeted communication strategies (e.g., Delaney & Kaiser, 2001; 
Macy & Bricker, 2007). The targeted strategies were naturalistic in nature and selected because 
they could be easily implemented across a variety of EC routines. During the first three weeks of 
baseline, data were collected on the following six communication strategies: commenting, 
modeling language, providing wait time, imitating language, expanding language, and contingent 
reinforcement (see Table 2 for definitions and examples). We identified each dyad’s three target 
strategies using the following procedures: (a) we calculated each teacher’s mean use of the six 
strategies from the first five sessions, (b) we created means for each dyad by averaging the two 
teachers’ scores together for each strategy, and (c) we selected the two strategies with the lowest 
mean scores for intervention. Each dyad’s selected strategies are presented in Table 5. 

Social validity. Teachers’ personal evaluations of BIE peer coaching were collected via 
semi-structured interviews to measure the intervention’s social validity. Interviews were 
conducted one-on-one by the first author four weeks after the conclusion of the maintenance 
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phase. The purpose of the measure was to identify teachers’ perceptions of the importance and 
effectiveness of the intervention, as well as teachers’ satisfaction with the BIE intervention. 

Procedures 

Across all research phases, researchers video-recorded teachers providing instruction to 
the children in their classrooms. Each video recording lasted 10 min and trained research 
assistants coded the videos at a later time. Teachers were asked to interact with children as they 
typically would while a researcher followed them throughout the room to capture their 
instructional practices with children. Teachers were instructed to interact with any and all 
children during the data-collection sessions. 

Baseline. Baseline sessions served as the teachers’ control phase as these sessions 
occurred prior to the receipt of PD. Data were collected for five (Dyad One) to 19 (Dyad Four) 
sessions. Teachers received no training, coaching, or reflection sessions during baseline. 

Intervention. The PD consisted of three components. First, co-teacher dyads received a 
90-min training. Then teachers participated in between a range of 5 and 7 weeks of BIE peer 
coaching. In addition, beginning in week 2, teachers participated in weekly reflection sessions. 

Teachers received the 90-min training session in their co-teacher dyads between their last 
baseline session and first intervention session, which resulted in either one or two days elapsing 
between the training and the first coaching session. The training was separated into the following 
three parts: (a) importance of children’s communication, (b) communication strategies, and (c) 
coaching strategies. Training included instruction on the dyad’s three targeted communication 
strategies (e.g., definitions, examples), modeling of the strategies (i.e., video, instructor), and 
opportunities to practice using them. The coaching aspect of the training included an overview of 
high-quality coaching strategies and BIE coaching. Teachers were instructed to provide at least 
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one prompt or praise to their co-teacher per min so that sufficient feedback could be received 
each session. Co-teachers practiced using the BIE technology with each other during the training. 

All dyads started with walkie-talkies and push-to-talk receivers (i.e., a wired earpiece 
with a button that could be pressed and spoken into so the co-teacher could hear the feedback). 
These BIE materials were chosen because of their affordability and ease of use, which proved to 
be true for the duration of the study for Dyads One and Four. However, given the acoustics of 
Dyad Two and Three’s classrooms, teachers experienced difficulties hearing one another during 
coaching sessions. Consequently, they switched from walkie-talkies to cell-phones (with wired 
in-the-ear headphones) to perform the BIE coaching. Each BIE peer-coaching session took place 
in the teachers’ typical environments (e.g., classroom, gross-motor room). Teachers either 
buckled the walkie-talkie to their clothes or placed it beside them during coaching sessions. For 
all BIE sessions, teachers wore their earpiece to receive feedback from their co-teacher. When 
co-teachers were serving as coaches, they were in the environment with the other teacher and 
children, but they did not provide instruction during this time. Rather, they used their respective 
BIE technology to observe their co-teacher for 10 min, providing performance feedback (i.e., 
prompts to use the strategies, praise for using strategies correctly) as opportunities arose during 
the activity. During each of the data collection sessions, a research assistant was present in the 
classroom to help manage the children while peer coaches focused on providing feedback to their 
co-teachers. Intervention included either five (i.e., Dyad Three) or six (i.e., Dyads One, Two, and 
Four) BIE peer coaching sessions across 3 weeks. Coaching sessions occurred twice a week and 
included 10 min receiving and 10 min delivering BIE coaching. 

Reflection sessions began during the second week of intervention (after either the second 
or third BIE session). Teachers received four 30 min, group reflection sessions. Each reflection 
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session included a co-teacher dyad and the first author; the only exception to this was that Desi 
participated in two of Deanna and Bess’s reflection sessions during her fading phase. We 
decided to include reflection sessions in order to increase understanding of the teacher processes 
that occur in BIE peer coaching, and to provide teachers additional support and opportunities for 
discussion. During reflection sessions, teachers spent between 5 and 10 min writing reflections 
on (a) their use of the strategies during the previous week, (b) the children’s response to the 
strategies, (c) their experiences with BIE peer coaching, and (d) their relationship with their co- 
teacher. Then, co-teachers orally reflected on these same four topics during the remaining 20 
min. The first author’s role was to facilitate discussion between the co-teachers and ask probing 
questions to assist teachers in thinking more deeply about the infonnation shared (e.g., thinking 
about methods to use contingent reinforcement that aligned with their philosophical beliefs). 
Reflection sessions ceased during the final week of the fading phase. 

Fading. Each co-teacher dyad received an individualized fading phase that reduced the 
intensity of the PD. Each dyad selected a preferred fading procedure from two options (see Table 
3 for options and selections). The rationale for providing two options was to ensure that teachers 
continued to feel supported in their PD while enhancing their buy-in to the intervention’s 
reduced intensity. The two choices varied per dyad based upon the first author’s perceptions of 
what would be most helpful to support teachers’ maintenance of skills; decisions primarily arose 
from information shared by teachers during reflections. The fading options were presented to co- 
teachers during their final reflection of the intervention phase and dyads were asked to select one 
of the two options. Fading phases lasted between five and eight sessions (3-4 weeks). 

Maintenance. Teachers received no PD during the maintenance phase and there were no 
interactions between the research team and teachers, with the exception of continued video 
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recording of each 10 min maintenance session. For Dyads One, Two, and Three, maintenance 
sessions occurred once per week and for Dyad Four, maintenance sessions occurred twice per 
week. This resulted in between three and eight weeks of maintenance data collected. 

Reliability and Implementation Fidelity of BIE Peer Coaching 

IOA was calculated following Kennedy’s (2005) total agreement method, which 
stipulates to divide the number of raters’ agreements by the total number of their agreements plus 
disagreements. Randomly selected sessions were coded for baseline (20%), intervention (24%) 
and maintenance (33%) phases. Additionally, an average of 25% of data were double coded for 
all participants (range = 21-27%). IOA was calculated on a session by session basis and then 
averaged across sessions with means equaling 94.8% (range = 91.7-99.2%) for expanding 
language, 93.2% (range = 79.2-99.1%) for imitating language, 97.8% (range = 90.8-100%) for 
modeling language, 97.6% (range = 90.8-100%) for contingent reinforcement, and 96.1% (range 
= 89.2-100%) for wait time. 

Implementation fidelity of BIE coaching. Trained research staff coded audio recordings 
for the quality and quantity of feedback provided during each coaching session. Implementation 
fidelity was detennined for quality based upon whether the immediate feedback was specific, 
positive, corrective (as needed), and on topic (Scheeler et ah, 2004). Specific feedback included 
a cue of which strategy to use and how to use it. Prompts that were encouraging in nature with 
respect to both content and tone, as well as all praise, were deemed to be positive. Corrective 
feedback was defined as prompts that included infonnation describing (a) what the co-teacher 
did and (b) how the co-teacher could use the strategies more effectively in the future. Finally, 
coaching was considered to be on topic if it cued the teacher to use one of her target strategies 
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and off topic if the content was about anything other than a strategy. Implementation fidelity was 
also detennined for quantity based upon teachers’ rate of feedback equaling one cue per min. 

The manner in which the peer coaching was implemented was consistent among the 
teachers (i.e., quality), but the intensity of feedback provided varied by teacher (i.e., quantity; see 
Table 4). Co-teachers delivered zero prompts or praises during baseline or maintenance (IOA = 
100%). Generally speaking, all of teachers’ feedback during the intervention and fading phases 
aligned with Scheeler and colleagues’ (2004) recommendations to be immediate, specific, and 
positive. Very little feedback (M= 1.3%) was corrective. Teachers delivered a mean of 1.61 
prompts (range = 0. 5-5.0) and 6.75 praises (range = 2.0-13.6) per session. Approximately 0.98 of 
these feedback cues (range = 0.4-2. 3) were off topic prompts/praise per session. 

Data Analysis 

We analyzed the data using visual analysis procedures outlined by Homer et al. (2005) 
and Kratochwill et al. (2013). Namely, we examined the data’s level, trend, variability, overlap, 
immediacy of effect, and consistency of patterns across research phases. However, given our 
interest in teachers’ increased use of strategies, we focused primarily on level changes across 
research phases. 

We completed masked visual analysis (Ferron & Jones, 2006) to determine if an 
individual naive to the progression of the research could identify the order in which our EC 
teacher dyads received intervention. The second author was not provided any infonnation 
regarding the progress of the research until she conducted a summative analysis (Ferron & 

Levin, 2014) at the end of the study by viewing eight individual line graphs of EC teachers’ data. 
She was instructed to select two teachers who she thought received intervention first, two who 
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received it second, two third, and two fourth. We randomized based upon dyad (n = 4) order, so 
there were 24 (= 4 x 3 x 2 x 1) possibilities for random assignment. 

Results 

Efficacy of the PD 

In this research we aimed to identify whether a peer-coaching PD package improved EC 
teachers’ use of evidence-based communication strategies by at least three times their baseline 
performance and whether those outcomes were sustained over time by at least twice their 
baseline perfonnance. Results are presented in Figure 1 and Table 5. Results are also described 
below individually for each EC teacher dyad and then summarized across dyads. 

Dyad One: Desi and Alante. Desi and Alante used an average of 6.40 (range = 3-9) and 
5.20 (range = 1-10) total communication strategies per baseline session, respectively. Desi had a 
decelerating trend in baseline, whereas Alante exhibited an accelerating trend. Upon receipt of 
the PD, there was an immediate improvement in their total use of the communication strategies, 
but their patterns were different. Desi had a large increase followed by a decelerating trend 
throughout intervention. None of Dyad One’s intervention data overlapped with their baseline 
data, but Alante’s accelerating trend in baseline continued into the intervention phase. Desi was 
the only teacher from Dyad One who completed the fading phase. By the third fading session, 
she peaked in performance at a level of 28 strategies per session; a decelerating trend was again 
noted, and she concluded the fading phase at a level of 13 strategies per session. Desi sustained 
this level of perfonnance ( m = 12.75; range = 7-18) for eight weeks after intervention concluded. 
Overall, Desi and Alante demonstrated an increase in all three strategies during intervention 
(with Desi’s usage 2. 1 times greater than her baseline performance and Alante’s 3 times greater 
than baseline). Desi also continued to increase her use of strategies into the fading phase (2.6 
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times greater than baseline), but she only sustained her use of reinforcing (2.2 times baseline) 
and expanding language (2.3 times baseline) at levels comparable to her performance during 
intervention (modeling was 1.5 times greater than baseline; see Table 5). 

Dyad Two: Deanna and Bess. Deanna used 8.60 (range = 4-12) and Bess used 7.70 
(range = 1-15) total communication strategies on average throughout the baseline phase. They 
had moderate variability, but a stable trend in their baseline data. Beginning the second session 
after the receipt of PD, there was a large increase in their use of communication strategies. Both 
teachers’ total strategy use declined after peaks on the second (Bess, n = 65) and third (Deanna, n 
= 75) sessions of intervention; however, they continued to use strategies at levels five times 
greater than their use during baseline phase throughout both the intervention and fading phases. 
At the start of the maintenance phase, there was a large decrease in Deanna’s performance, with 
her mean use of communication strategies equal to 14.50 (range = 6-23), which was 1.68 times 
greater than her baseline performance. Deanna used modeling language 10.8 times more in 
maintenance than baseline, but this was not observed for imitating language (.95 times baseline) 
or contingent reinforcement (1.1 times baseline). There was a decline in Bess’s maintenance 
perfonnance by roughly 1 5 communication strategies per session compared to 
intervention/fading, but she still maintained an increase in her use of all three strategies when 
compared with baseline (modeling = 2.4 times baseline; imitating = 3.9 times baseline; and 
contingent reinforcement = 2.3 times baseline). 

Dyad Three: Elise and Francesca. Elise used an average of 2.73 (range = 0-8) and 
Francesca used 3.87 (range = 0-8) total communication strategies throughout baseline. Both 
teachers’ baseline data demonstrated minimal variability and stable trends. There was an 
immediate effect of the PD on their use of the strategies in the intervention phase (i.e., more than 
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5 times greater than baseline; Elise, m = 22.40, range = 14-29; Francesca, m = 20.40, range = 13- 
26), which was maintained during the fading phase (i.e., more than 6 times greater than baseline; 
Elise, m = 16.60, range = 1 1-26; Francesca, m = 27.80, range = 25-33). There was more 
variability in Elise and Francesca’s intervention data than in baseline. This variability continued 
into the fading phase for Elise but stabilized for Francesca. For the first week following 
completion of PD, Elise used the strategies at levels comparable to the intervention phase. Elise’s 
performance throughout the rest of maintenance, and Francesca’s performance during the entire 
maintenance phase was more similar to baseline than intervention (Elise, m = 1 1.00, range = 2- 
11,4 times greater than baseline; Francesca, m = 5.80, range = 2-11, 1.5 times greater than 
baseline). 

Dyad Four: Zaire and Iza. Zaire and Iza had stable baseline trends with minimal 
variability. Their mean use of total communication strategies was 3.58 (range = 0-10) and 2.89 
(range = 0-6), respectively. Upon initiation of the PD, Zaire’s perfonnance demonstrated an 
immediate effect for the first session, but then her strategy use declined back to baseline level 
throughout the remainder of data collection (intervention performance was 2.3 times baseline, 
fading was 0.56 times baseline, and maintenance was 0.93 times baseline). Five out of six 
intervention sessions, as well as all of the fading and maintenance sessions overlapped with 
baseline. These patterns were not the same for Iza, who, upon receipt of the PD, demonstrated an 
immediate increase in her use of total strategies. Iza’s strategy use decreased slightly after the 
first two intervention sessions; however, she maintained this elevated level with minimal 
variability through the remained of the intervention phase (4.2 time baseline performance) and 
through her fading phase (3.5 times baseline). Iza sustained the growth she made from the PD 
into the maintenance phase, but her perfonnance was more variable (m = 13.60, range = 3-31, 
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4.7 times baseline). Iza’s maintenance perfonnance reflected increases at least double baseline 
perfonnance for the strategies of modeling (14.5 times baseline) and contingent reinforcement 
(2.6 times baseline), but not wait time (1.7 times baseline). 

Efficacy across teacher dyads. The dyads’ baseline data were consistently low with 
minimal variability and stable trends. The PD had an immediate effect on teacher dyads’ use of 
total communication strategies from the first intervention session for Dyads One, Three, and 
Four, and from the second session for Dyad Two. In their interviews, Dyad Two teachers 
indicated that at the start of intervention, they needed extra time to familiarize themselves with 
the strategies; this may have been why it took an extra coaching session to observe an effect. 
Throughout the intervention and fading phases, dyads demonstrated more variability in their use 
of the strategies when compared to their baseline data, with trends that were mixed among dyads. 

Notably, the level changes in dyad perfonnances were diverse, ranging from 
improvements of seven (Dyad One) to approximately 40 (Dyad Two) strategies per session. This 
variability in performance was observed across the fading and maintenance phases as well. 
During the intervention and fading phases, Dyads Two and Three at least tripled their baseline 
performance (our hypothesis for aim 1) and Dyad One at least doubled their baseline 
perfonnance. For the maintenance phase, only Dyad Two sustained their use of the strategies at a 
level at least double that of their baseline perfonnance (our hypothesis for aim 2). Additionally, 
when considering growth in teacher dyads’ use of individual strategies (Table 5) during PD, 
Dyads One and Two improved in all three of the strategies, Dyad Three improved in two 
strategies, and Dyad Four did not improve in any strategies. Maintenance was observed for at 
least one strategy for Dyad Two, but then results were mixed for the other dyads with only Desi, 
Elise, and Iza maintaining strategies for Dyads One, Three, and Four, respectively. 
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According to What Works Clearinghouse guidelines, this research demonstrates moderate 
evidence that the PD affected teacher dyads’ use of the strategies (i.e., determined because the 
PD improved the total frequency with which three of the four dyads used the communication 
strategies; Kratochwill et ah, 2013). Moreover, the masked visual analyst identified the order in 
which dyads received intervention on the first try, so 1 was divided by 24 (total random 
assignments) to detennine the probability that the PD affected the frequency of teacher dyads’ 
use of communication strategies. Thus, outcomes of our masked visual analysis resulted in a 
value of p = .042, which provides additional confidence in our visual analysis, demonstrating a 
functional relation between the PD and teacher dyads’ practices. 

Social Validity of BIE Peer Coaching 

All dyads reported some challenges associated with BIE peer coaching (e.g., ensuring 
feedback was not repetitive), but they also thought that it was an acceptable form of PD, which 
was evidenced by their indication that they were willing to use BIE peer coaching again and that 
they would recommend it to other teachers and families. Teachers identified the most important 
aspects of BIE peer coaching to be receiving immediate (n = 7), specific (n = 2), and positive (n 
= 1) feedback; real-world practice opportunities (n = 2); and the dual coaching nature of the 
intervention (n = 1). Teachers perceived that BIE peer coaching enriched the quality of their 
teaching by improving their ability to use the strategies (n = 5) and producing a more conducive 
language and literacy environment ( n = 3). They also perceived that it improved their children’s 
communication (n = 7), vocabulary (n = 2), social-emotional development (n = 2), and 
engagement in classroom activities (n = 2) - although they indicated that when using the 
strategies, some children did not respond ( n = 2). 
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Discussion 

The purpose of this study was to examine the effects of a PD package with BIE peer 
coaching on four EC teacher dyads’ use of evidence-based communication strategies. This study 
adds to the body of literature on BIE coaching by utilizing co-teachers as BIE peer coaches. 

Efficacy of BIE Peer Coaching 

The results of this research provide preliminary evidence that BIE peer coaching can be 
effective for increasing EC teacher dyads’ use of evidence-based strategies. Our findings were 
more variable than those obtained by previous researchers, as all teachers in Scheeler et al.’s 
(2010) study coached each other to use complete leam units, with all teachers demonstrating 
positive outcomes. In contrast, in our study, teacher dyads coached each other on three strategies, 
and usage of the strategies varied from 12 to 50 strategies for the three teacher dyads with 
demonstrations of an effect. Given that this was the first study to examine BIE peer coaching in 
an EC setting, replications are necessary to inform the intervention’s use with other EC teacher 
dyads. 

Additionally, the considerable variability in outcomes across teacher dyads warrants 
future research. Multiple explanations are plausible to explain why outcomes were variable 
across teacher dyads, such as differences in (a) the opportunities available to use strategies 
during sessions, (b) teachers’ views regarding how often they should be using the strategies, (c) 
types of classroom activities, (d) complexities associated with coaching multiple strategies, (e) 
teacher- and dyad-level characteristics, (f) selecting strategies based upon dyad instead of 
teachers as individuals, and (g) BIE implementation. Consequently, future research should 
systematically examine these aspects to determine if there are associations among these variables 
and the outcomes of teacher dyads receiving BIE peer coaching. 
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Fading as a Method for Promoting Maintenance 

Based on the recommendations of previous BIE researchers (Ottley & Hanline, 2014, 
2015b; Scheeler, Bruno, Grubb, & Seavey, 2009; Scheeler et al., 2010), we used a systematic 
fading procedure to increase EC teacher dyads’ maintenance of the communication strategies. 
Although three of the four dyads sustained their use of total coached strategies during the fading 
phase, only one dyad maintained their use of the strategies post intervention. We hypothesized 
that teachers’ frequency of strategy use would decline, but remain at least double that of baseline 
levels. Although this pattern was found for some dyads, not all teachers maintained the use of 
communication strategies at levels that could be considered as having practical importance when 
coaching was no longer in place, despite the systematic implementation of fading procedures. 

Our procedures differed from Scheeler et al.’s (2010) study in that we faded the amount 
of PD support provided to teacher dyads, instead of the use of BIE technology. Some of these 
procedures (e.g., shortened BIE sessions) may have been more effective in supporting teachers’ 
maintenance of communication strategies than others. In addition, Scheeler and colleagues 
required a level of teacher mastery. Although our teacher dyads demonstrated correct use of 
strategies, their levels of strategy use were much more variable, which may have contributed to 
the variability in sustained outcomes. Finally, Scheeler et al.’s maintenance data were collected 
between one and three weeks after intervention ceased, but our maintenance data were measured 
for three to eight weeks following the conclusion of the fading phase. These differences make it 
difficult to compare our teachers’ maintenance with that of teachers from other studies. 
Collectively, these findings lend themselves to multiple areas for additional research, such as (a) 
examining the benefits of teachers achieving a criterion level before ceasing intervention, (b) 
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exploring the use of different fading procedures, and (c) evaluating the long-tenn maintenance of 
teachers’ skills. 

Social Validity of BIE Peer Coaching 

All EC teachers in our study reported BIE peer coaching to be a socially valid approach 
to PD in terms of the intervention’s importance and perceived effectiveness, with some 
challenges noted with the intervention’s feasibility (i.e., technology, maintaining attention to the 
coach while working with children, keeping the feedback from becoming redundant). However, 
even with these feasibility challenges, EC teachers perceived that BIE peer coaching increased 
the quality of their teaching and improved children’s communication. Our results were consistent 
with those obtained in other BIE studies in which researchers implemented the coaching with EC 
teachers (e.g., Ottley et al., 2015) and teachers implemented the intervention with their co- 
teachers (Fry & Hin, 2006; Scheeler et al., 2010). Even so, given the diversity in EC classrooms, 
future researchers should examine methods to improve the feasibility of BIE coaching to aid in 
the ease of its use among other EC teacher dyads. 

BIE Peer Coaching as a Method for Addressing the Research-to-Practice Gap 

Despite the growing body of knowledge on evidence-based strategies in EC education 
(Odom et al., 2010; Odom & Wolery, 2003), lack of teacher implementation of evidence-based 
strategies remains an ongoing concern of leaders in the field (Cook & Odom, 2013; Odom, 

2008). Coaching may be a particularly promising fonn of PD for increasing teacher use of 
evidence-based strategies (Fixsen, Naoom, Blase, Friedman, &Wallace, 2005) because the 
feedback is situated within the teacher’s daily practice and immediately relevant. Peer coaching 
may provide added benefit because the coaching is not only inherently contextually relevant, but 
also provided by a colleague, thereby minimizing power differentials between members of the 
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dyad (Scheeler et al, 2010). Thus, this study provides preliminary evidence that BIE peer 
coaching may be one means for decreasing the research-to-practice gap in EC education. 
However, additional research is warranted to identify whether these findings replicate with other 
(a) EC teacher dyads, (b) instructional practices, and (c) types of EC environments. 

Limitations 

A limitation of this study is that one peer-coaching dyad was disrupted when one co- 
teacher terminated her teaching position at the EC center. This resulted in limited data for this 
teacher and may have impacted results for co-teacher, who received the remainder of her 
coaching sessions from another EC teacher participating in the study. In addition, all teachers in 
this study worked in the same childcare center, which limits our ability to generalize the findings 
beyond this setting. This also allowed for the possibility of contamination as teachers had 
opportunities to communicate about the study and their participation with other dyads. Another 
area of concern is that we selected teachers’ targeted strategies at the dyad level. This was done 
for practical purposes, however one teacher in the dyad may have had different needs and 
because we did not address individual teacher needs, we were unable to make conclusions 
regarding the intervention’s efficacy at the individual teacher level. Additionally, we did not 
systematically examine fidelity data for training teachers on the coaching practices, nor did we 
investigate differences in teachers’ coaching processes, which may have impacted the efficacy 
and implementation of BIE peer coaching and teachers’ use of targeted strategies. Lastly, our 
masked visual analysis procedures were different from those outlined by Ferron and Jones 
(2006), because our masked visual analyst identified phase changes at the dyad level; this may 
have increased the likelihood of an accurate response by the masked visual analyst. 
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Conclusion 

In this study, we examined the effects of PD including BIE peer coaching on four EC 
teacher dyads’ use of evidence-based communication strategies. Although three EC teacher 
dyads in our study at least doubled their use of the communication strategies during intervention, 
only one dyad maintained their use of all three strategies post intervention at levels at least twice 
that of their baseline performance. The research-to-practice gap remains a critical issue in 
education with progressive approaches to PD (e.g., coaching; Odom, 2008) remaining one of the 
most promising avenues for bridging this gap and for weaving evidence-based practices into EC 
classrooms. BIE peer coaching is one such approach that should be examined further to increase 
the consistency in effects across EC teacher dyads and to promote sustained use of coached 
strategies post intervention. With fine tuning, BIE peer coaching may be an avenue to bridge the 
research-to-practice gap in EC education. 
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Table 1 


EC Teachers ’ Demographic Descriptions 


Participant 

Age 

Race 

Education 

Experience 

Role 

Desi 

35 

Asian Indian 

Bachelor’s 

12 years 

Master 

Alante 

— 

African American 

Associate’s 

8 years 

Assistant 

Deanna 

32 

Caucasian 

Master’s 

1 1 years 

Master 

Bess 

28 

Caucasian 

Bachelor’s 

5 years 

Lead 

Elise 

28 

Caucasian 

Master’s 

6 years 

Master 

Francesca 

25 

Caucasian 

Bachelor’s 

3 years 

Lead 

Zaire 

28 

African American 

Master’s 

4 years 

Master 

Iza 

24 

Multiple races 

Bachelor’s 

1 year 

Assistant 


Note. Participant names are pseudonyms. 
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Table 2 

Evidence-Based Communication Strategies 


Strategy 

Definition 

Example 

Commenting 

Describing things that occur in the 
environment. 

The sand is falling through the 
funnel. 

Language 

modeling* 

Explicitly requesting a child to 
communicate (via gesture or words) 
a word or phrase provided to 
him/her. 

Can you say thermometer? 

Point to the toy with which you 
want to play. 

Providing wait 
time* 

Pausing for at least 3 seconds after 
communicating to give the child a 
chance to respond. 

What book would you like to 
read? Pause of at least 3 seconds 
before asking again 

Imitating 

language* 

Repeating exactly what the child has 
communicated. 

Child: Da-da 

Teacher: Da-da 

Expanding 

language* 

Repeating what the child has 
communicated and then adding 
language to supplement the child’s 
word(s). 

Child: I failed. 

Teacher: You fell down. 

Contingent 

reinforcement* 

Providing specific positive verbal 
feedback for the child’s 
communication attempt; or, 
providing a natural, reinforcing 
consequence for the child’s 
communication attempt. 

Great words to let Simon know 
wanted to play blocks with him. 

Giving a child more milk if the 
child signed “more.” 


Note. * = a communication strategy targeted by at least one co-teacher dyad for intervention 
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Table 3 

Fading Procedures among Teacher Dyads 


Dyad 

Fading Option 1 

Fading Option 2 

Rationale for Choices 

One 

Receive BIE peer 
coaching from Bess 

End the BIE peer 
coaching early, but 
continue reflections 
with Dyad Two 

Alante was quitting her job and 
these two options were the only 
feasible ones for continued PD. 

Two 

Reduce the frequency 
with which feedback 
was provided during 
the 10-min coaching 
sessions 

Shorten the length of 
the coaching sessions 
to 5 min each 

Deanna and Bess were using the 
communication strategies very 
frequently and effectively and 
they thought they could continue 
to do so without the coaching. 

Three 

Complete the 10-min 
coaching sessions 
without a research 
assistant in the 
classroom 

Shorten the length of 
the coaching sessions 
to 5 min each 

Elise and Francesca were 
concerned that they may not use 
the communication strategies post 
intervention given the realistic 
demands of their classroom 
without researcher assistance. 

Four 

Complete the 10-min 
coaching sessions 
without a research 
assistant in the 
classroom 

Independently conduct 
their reflection 
sessions without the 
first author facilitating 

Zaire and Iza had more variable 
data than the other dyads, so 
maintaining the intensity of 
coaching sessions seemed 
important. These two options 
aimed to enhance their ownership 
of the PD and use of the strategies. 


Note. The italicized options were the ones selected by the co-teacher dyads. 
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Table 4 


Implementation of BIE Peer Coaching 


Teacher 

Percent 

Immediate 

Percent 

Specific 

Percent 

Positive 

Percent 

Corrective 

No. 

Prompts 

No. 

Praise 

No. Off 
Topic 

Desi 

100% 

96.7% 

100% 

0% 

2.3 

3.2 

2.3 

Alante 

100% 

93.9% 

100% 

0% 

1.7 

2.0 

1.7 

Deanna 

100% 

96.9% 

100% 

0% 

5.0 

9.0 

0.6 

Bess 

100% 

94.7% 

99.0% 

1.0% 

3.1 

13.6 

0.8 

Elise 

100% 

100% 

100% 

1.9% 

1.3 

6.9 

0.4 

Francesca 

100% 

94.8% 

100% 

3.3% 

1.5 

10.1 

1.1 

Zaire 

100% 

93.7% 

100% 

4.0% 

0.7 

6.3 

1.3 

Iza 

100% 

65.8% 

100% 

0% 

0.5 

2.9 

1.6 
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Table 5 


Teachers ’ Mean use of Three Targeted Evidence-Based Communication Strategies per Session 
across Research Phases 


Dyad One: Desi & Alante 


Modeling 

Reinforcement 

Expanding 

Total Strategies 

Desi Baseline 

2.00 

2.20 

2.20 

6.40 

Desi Intervention 

4.33 

4.33 

5.00 

13.67 

Desi Fading 

4.88 

5.25 

6.38 

16.50 

Desi Maintenance 

3.00 

4.75 

5.00 

12.75 

Alante Baseline 

0.20 

1.60 

3.40 

5.20 

Alante Intervention 

4.17 

3.83 

7.67 

15.67 

Dyad Two: Deanna & Bess 


Modeling 

Reinforcement 

Imitating 

Total Strategies 

Deanna Baseline 

0.60 

2.40 

5.60 

8.60 

Deanna Intervention 

16.67 

5.00 

27.00 

48.67 

Deanna Fading 

24.71 

4.43 

21.14 

50.29 

Deanna Maintenance 

6.50 

2.67 

5.33 

14.50 

Bess Baseline 

0.80 

2.50 

4.40 

7.70 

Bess Intervention 

19.67 

4.83 

26.33 

50.83 

Bess Fading 

33.86 

7.29 

22.71 

64.14 

Bess Maintenance 

19.50 

5.67 

17.33 

42.40 

Dyad Three: Elise & Francesca 


Modeling 

Reinforcement 

Wait Time 

Total Strategies 

Elise Baseline 

1.00 

0.27 

1.47 

2.73 

Elise Intervention 

12.60 

4.60 

5.20 

22.40 

Elise Fading 

7.60 

4.80 

4.20 

16.60 

Elise Maintenance 

4.00 

2.40 

4.60 

11.00 

Francesca Baseline 

0.80 

0.20 

2.87 

3.87 

Francesca Intervention 

13.40 

3.20 

3.80 

20.40 

Francesca Fading 

11.60 

11.60 

4.60 

27.80 

Francesca Maintenance 

2.00 

1.00 

2.80 

5.80 

Dyad Four: Zaire & Iza 


Modeling 

Reinforcement 

Wait Time 

Total Strategies 

Zaire Baseline 

1.68 

1.11 

0.79 

3.58 

Zaire Intervention 

2.17 

3.83 

2.17 

8.17 

Zaire Fading 

1.00 

0.40 

0.60 

2.00 

Zaire Maintenance 

1.67 

0.00 

1.67 

3.33 

Iza Baseline 

0.58 

1.47 

0.84 

2.89 

Iza Intervention 

6.83 

4.33 

1.00 

12.17 

Iza Fading 

6.40 

2.60 

1.00 

10.00 
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Iza Maintenance 8.40 3.80 1.40 13.60 

Note. Modeling = modeling language; reinforcement = contingent reinforcement; expanding = 
expanding language; imitating = imitating language; wait time = providing wait time 



Frequency of Teacher Dyads' Use of Three Targeted Strategies during 10-min Sessions 



10-min Sessions 


Figure 1. Early childhood teacher dyads' total use of three targeted evidence-based 
communication strategies within naturally occurring classroom routines and activities. 


